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Abstract 

An iterative scheme for solving ill-posed nonlinear operator equations with monotone 
operators is introduced and studied in this paper. A Dynamical Systems Method 
(DSM) algorithm for stable solution of ill-posed operator equations with monotone 
operators is proposed and its convergence is proved. A new discrepancy principle is 
proposed and justified. A priori and a posteriori stopping rules for the DSM algorithm 
are formulated and justified. 
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1 Introduction 

In this paper we study a Dynamical Systems Method (DSM) for solving the equation 

F(y) = f, (i) 

where F is a nonlinear twice Frechet differentiable monotone operator in a real Hilbert 
space H , and equation (pQ) is assumed solvable. Monotonicity is understood in the following 
sense: 

(F(u) -F(v),u- v) > 0, Vu,veH. (2) 

It is known (see, e.g., [5]), that the set N := {u : F(u) = /} is closed and convex if F 
is monotone and continuous. A closed and convex set in a Hilbert space has a unique 
minimal-norm element. This element in J\f we denote by y, F{y) = f. We assume that 

sup \\F^(u)\\<Mj(R), 0<j<2, (3) 

\\u—uo\\<R 



'Email: nguyenhs@math.ksu.edu 

^Corresponding author. Email: ramm@math.ksu.edu 



1 



where uq £ H is an element of H, R > is arbitrary, and / = F(y) is not known but fs, 
the noisy data, are known and \\f$ — f\\ < S. If F'{u) is not boundedly invertible then 
solving for u given noisy data fs is often (but not always) an ill-posed problem. 

Our goal is to develop an iterative process for a stable solution of equation ([1]) , given 
noisy data fs, \\f — fs\\ < S. The idea of this iterative process is similar to the ideas of the 
DSM method in [2], [5]-|12j. In [3]-[5] and references therein methods for solving ill-posed 
problems are discussed. 

2 Auxiliary and main results 

We assume throughout the paper that < (a n )^ =0 \ 0. 
2.1 Auxiliary results 

The inner product in H is denoted (u,v). Let us consider the following equation 

F(V 8 ) +aV s -f s = 0, a> 0. (4) 

It is known (see, e.g., [1]) that equation © with monotone continuous operator F has a 
unique solution for any fixed a > and f$ £ H. 

Lemma 1 If ([2]) holds and F is continuous, then \\Vs\\ = O(-) as a oo, and 

lim \\F(Vs) - fs\\ = \\F(0) - fs\\. (5) 

a— >oo 

Proof. Rewrite © as 

F(V S ) - F(0) + aV 6 + F(0) - fs = 0. 

Multiply this equation by Vs, use the inequality (F(Vg) — F(0), V$ — 0} > 0, which follows 
from ([2]), and get: 

a\\Vsf< (aVs + F(Vs)-F(0),Vs) = (fs-F(0),Vs) < \\f 5 - F(0)\\\\V s \\. 

Therefore, [|T^[| = 0{\). This and the continuity of F imply ©. □ 

Let us consider the following equation 

F{V n>s ) + a n V n .s -fs = 0, a n > 0. (6) 

Let us denote V n := V n> s when 5^0. From the triangle inequality one gets: 

\\F(V ) - fs\\ > \\F(0) - f s \\ - \\F(V ) - F(0)||. 

From the inequality ^(Vo) — -^(0)11 < Mi||Vo|| and Lemma[T]it follows that for large ao 
one has: 

\\F(V ) - F(0)\\ < Afi[|Vb|| =°(^)- 

Therefore, if \\F(0) - f 5 \\ > C5, then \\F(V ) - f 5 \\ > (C - e)5, where e > is arbitrarily 
small, for sufficiently large ao > 0. 
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Lemma 2 Suppose that \\F(0) — f$\\ > CS, C > 1. ^4ss?/me i/iat < (a n )^L \ 0, and 
ao «s sufficiently large. Then, there exists a unique n$ > 0, such that 

\\F(V ns ) - f s \\ <CS< \\F(V n ) - f s \\, Vn<n 5 . (7) 

Proof. We have F{y) = /, and 

= (F(V n ) + a n V n - f s , F(V n ) - f s ) 
= \\F(V n ) - fsf + a n (V n - y,F(V n ) - fs) + a n {y,F{V n ) - f s ) 

= \\F(V n ) - fsf + a n (V n - y, F{V n ) - F{y)) + a n (V n -yj-fs)+ a n (y, F(V n ) - fs) 
> \\F(V n ) - fsf + a n (V n -y,f-fs)+ a n (y, F(V n ) - f s ). 

Here the inequality (V n — y,F(V n ) — F(y)) > was used. Therefore 

\\F(V n ) - fsf < -a n (V n -yj-fs)- a n (y, F(V n ) - fs) 

< a n \\V n - 2/IHI/ - fs\\ + a n \\y\\\\F(V n ) - f s \\ (8) 

< a n 5\\V n - y\\ + a n \\y\\\\F(V n ) - f 5 \\. 

On the other hand, one has: 

= (F(V n ) - F(y) + a n V n + f-f 5 ,V n -y) 
= (F(V n ) - F(y), V n -y)+ a n \\V n - yf + a n (y, V n - y) + (/ - fs, V n - y) 
> a n \\V n - yf + a n (y,V n - y) + (/ - f s ,V n - y), 

where the inequality (V n — y,F(V n ) — F(y)) > was used. Therefore, 

a n \\V n - yf < a n \\y\\\\V n - y\\ + S\\V n - y\\. 

This implies 

a n \\V n - y\\ < a n \\y\\ + 5. (9) 
From dH) and ([9]), and an elementary inequality ab < ea 2 n + ^, Ve > 0, one gets: 

\\F(V n ) - fsf <5 2 + a n \\y\\5 + a n \\y\\\\F(V n ) - f s \\ 

< S 2 + a n \\y\\5 + e\\F(V n ) - fsf + ^<4lM| 2 , ' 

where e > is fixed, independent of n, and can be chosen arbitrary small. Let n — > oo 
so a n \ 0. Then CEU|) implies lim^oofl - e)\\F(V n ) - fsf < 5 2 , Ve > 0. This implies 
lim n _ i . o0 — fs\\ < 5. This, the assumption ||F(0) — fs\\ > CS, and the fact that 

11-^(^1 ) — fs\\ is nonincreasing (see Lemma HJ, imply that there exists a unique ns > 
such that ([7|) holds. Lemma [5] is proved. □ 

Remark 3 Let Vo, n '■= Vs >n \s=o- Then F(Vb,n) + CL n Vo, n — / = 0. It was proved in [5] that 
||^b,n|| < ||y||> where y is the minimal- norm solution to F(u) = f, and that 

S 

\\Vs,n — Vo,n\\ < • 
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Thus, one gets the following estimate: 

S S 

\\V n \\ < \\Vo, n \\ + — < \\y\\ + — , V n :=V s , n - (11) 

Cl n d n 

Lemma 4 Let < a n \ 0, and F be monotone. Denote 

h n :=\\F(V n )-f s \\, gn:=\\V n \\, n = 0,l,..., 

where V n solves © with a = a n . Then h n is nonincreasing, and g n is nondecreasing. 

Proof. Note that h n = a n ||V^||. One has 

< (F(V n ) - F(V m ), V n - V m ) 
= (-a n V n + a m V m , V n - V m ) (12) 

— (fln Q"m)(V n , V m ) On||^n|| Q'mll^mll ■ 



Thus, 



ifln o , m)(V n , V m ) a n \\V n \\ a m \\ V m || 
< (a n + a m )||y n ||||y m || - a n ||y n || 2 - a m ||y m || 2 

= (anllKH - Omll'KnlDGI'Vmll ~ IIKII) 
= (h n - h m )(g m - g n ). 

If g-m > gn then (fl~3l) implies h n > h m , so 

O'ngn ^ Q"m,gm ^ ^mffn- 

Thus, if g m > g n then a m < a n and, therefore, m > n, because a n is decreasing. 
Conversely, if g m < g n then h n < h m . This implies a m > a n , so m < n. 
Therefore h n is nonincreasing and g n is nondecreasing. Lemma [5] is proved. □ 

Remark 5 From Lemma Q] and Lemma H] one concludes that 

a„||K|| = \\F(V n ) ~ fs\\ < \\F(0) - M|, Vn > 0. 

Lemma 6 Suppose M\, cq, and c\ are positive constants and ^ y £ H . Then there exist 
A > and a sequence < (a n )^L \ such that the following conditions hold 

a n < 2a n+ i, (14) 
11/5-^(0)11 (15) 

*f< hi (16) 
a n — a n+ \ 1 



(13) 



a 



2 

n+l 



£ 2cTa' (17) 



coto h c i < — r~ ■ (is) 

X z a n+ i A 
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Proof. Let us show that if < ao is sufficiently large then the following sequence 

a. = ^ (19) 

satisfy conditions (fH|) - (fl8|) . One has 

a n n + 2 



a n +l n + l 



< 2, Vn>0. 



Thus, inequality is obtained. 
Choose 

llyll 

then inequality (fT6l) is satisfied. 

Inequality ([15]) is obtained if ao is sufficiently large. Indeed, (fT5j) holds if 



«o > VAH/i-FCOJH. (21) 

Let us check inequality fPTj) . One has 

a n - a n+ i / a a \ (n + 2) 2 n + 2 2 

— — < — n > U. 



a^ +1 \ 1 + n 2 + n/ a§ a (n + 1) a 

Thus, (HZD hold if 

2 1 

- < ^v, (22) 
ao 2ciA 

i.e., if ao is sufficiently large. 

Let us verify inequality (fPgj). Assume that (a n )^ =0 and A satisfy (fTj]) - (fTT|) and (fTUj) . 
Choose k > 1 such that 

2c 1 

£ £ 2' (23) 

Consider the sequence (& n )5£L := ( Ka n)5S=o anc ^ ^« := Using inequalities (fill) . (fTTl) 
and (p3|) . one gets 

b n — b n+ i 2co a ra a n — a n+ i 

A£ ft n+ i kA 2A a n+ i 

^ 1 a n+l a n+l _ On+1 _ &n+l 

2 A 2A A A^ 

Thus, inequality (fTHI) holds for a„ replaced by b n = Ka n and A replaced by X K = nX, where 
k > max(l, ^) (see ()23p ). Inequalities (|14p - (|17p hold as well under this transformation. 
Thus, the choices a n = and A := K |j|jp K > max(l, 4c ^|^ ), satisfy all the conditions 
of Lemma □ 

Remark 7 Using similar arguments one can show that the choices A > 0, a n = pj^jjs , 
d > 1, < 6 < 1, satisfy all conditions of Lemma [6] provided that do is sufficiently large 
and A is chosen so that inequality (|20|) holds. 
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Remark 8 In the proof of Lemma ao and A can be chosen so that ^ is uniformly 
bounded as 5 —* regardless of the rate of growth of the constant Mi = M\(R) from 
formula (3) when R — > oo, i.e., regardless of the strength of the nonlinearity F(v). 

Indeed, to satisfy ([20]) one can choose A = tt^t. To satisfy ([2T]) and ([22]) one can choose 

a = max (yA||/ 5 - F(0)||, 4cia) < max ^/A(||/ - F(0)|| + 1), 4 Cl A 

where we have assumed without loss of generality that < 5 < 1. With this choice of ao 
and A, the ratio ^ is bounded uniformly with respect to 5 € (0, 1) and does not depend 
on R. 

Indeed, with the above choice one has ^ < c(l + V A -1 ) < c, where c > is a constant 
independent of 5, and one can assume that A > 1 without loss of generality. 

This Remark is used in the proof of main result in Section 2.2. Specifically, it will 
be used to prove that an iterative process (25) generates a sequence which stays in a ball 
B(uq, R) for all n < no + 1, where the number no is defined by formula (36) (see below), 
and R > is sufficiently large. An upper bound on R is given in the proof of Theorem 
10, below formula (47). 

Remark 9 It is easy to choose uq £ H such that 

g := \\u - Vb || < • (24) 

a 

Indeed, if, for example, no = 0, then by Lemma [2] and Remark [5] one gets 

livil a oll y oll < \\ F ^)-UW 



ao ao 
If (USD and ([MD hold then g < ^. 

2.2 Main result 

Let V n! s solve the equation: 

F(V n , s ) + a n V ntS -fs = 0. 

Denote V n := V n j. 

Consider the following iterative scheme: 

u n+1 = u n - A^-[F(u n ) +a n u n - f s ], A n := F'(u n ) + a n I, u = u , (25) 

where no is chosen so that inequality (|24p holds. Note that F'(u n ) > since F is monotone. 
Thus, \\A-i\\ <± ' 

Let a n and A satisfy conditions (fT4"]) - ([T8]) . Assume that equation F(u) = f has a 
solution y G B{uq,R), possibly nonunique, and y is the minimal-norm solution to this 
equation. Let / be unknown but fs be given, and \\f$ — /|| < 5. We have the following 
result: 
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Theorem 10 Assume a n = where d > 1, 0<6< 1, and do is sufficiently large so 



that conditions (ll4p -( fT8l) hold. Let u n be defined by (J25J). Assume that uq is chosen so 
that (|24p holds. Then there exists a unique n$ such that 

\\F(u ns ) - f s \\ < CxSTi, CtP <\\F(u n )-f s \\, Vn < n s , (26) 

where C\ > 1, < 7 < 1. 

Let < (6rn)m=l ^ e a sequence such that 5 m — > 0. If N is a cluster point of the 
sequence n& m satisfying ([26]) . then 

lim u n Sm = «*> ( 27 ) 

m— >oo m 

where u* is a solution to the equation F(u) = f . If 

lim n Sm = 00, (28) 



where 7 G (0, 1), then 

Proof. Denote 
Let 

%n ■ 

We use Taylor's formula and get: 



lim |K, - y\\ = 0. (29) 



C := °±±±. (30) 



"Un ? <?n • — 1 1 Zn I 



M 2 

F(u n ) - F(Vn) +a n z n = Aa n z n + K n , \\K n \\ < — \\z n \\ , (31) 

where K n := F(u n ) - F(V n ) - F'{u n )z n and M2 is the constant from ([3]). From (I25p and 
(pJTj) one obtains 

z n+ i = z n - z„ - A" 1 ^^) - (K+i - V n ). (32) 
From ([32]) . (|3T|) . and the estimate H^L^ 1 )! < — , one gets 

9n + i<^ + \\V n+1 -V n \\. (33) 
2a n 

Since < a n \ 0, for any fixed 5 > there exists n such that 

— > tt^-tIMI > A C>1. (34) 
By (HH), one has < 2, Vn > 0. This and ([Ml) imply 

2 „ 25 5 1 , „ 6 

7T— rW> — > > t^—112/II > —, C>1. (35) 
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Thus, 

-?—\\y\\>— , Vn<n + 1. (36) 
o — i a n 

The number no, satisfying (|36p . exists and is unique since a n > monotonically decays to 
as n — * oo. By Lemma there exists a number n% such that 

||F(y m+1 ) - M| <C5< \\F(V ni ) - M\, (37) 

where V n solves the equation F(V n ) + a n V n — fs = 0. VFe claim that rii £ [0, no]. Indeed, 
one has \\F(V ni ) - fs\\ = a ni \\V ni \\, and \\V ni \\ < \\y\\ + ^ (cf. (jnj), so 

C<5 < a^UKxIl < sf ||y|| + — ) = omllyll +5, C > l. (38) 



Therefore, 
Thus, by ([35]), 



5 < ^M. (39) 



^ IMI 5 s 
— < < . (40) 



Here the last inequality is a consequence of (|35j) . Since a n decreases monotonically, in- 
equality (|4T)]) implies ni < no- One has 

an+i||K - Vn+i\\ 2 = {(a n +i ~ a n )V n - F(V n ) + F(V n+ i), V n - V n+1 ) 

< ((on+i - a n )V n , V n - K+i) (41) 

< (a n - a n+ i)||T^.||||K - V n+ i\\. 

By (HH), \\V n \\ < \\y\\ + and, by ((36)), £ < |H f °r all n < n + 1. Therefore, 

IIKH < Ibll ( 1 + ^3t) > Vn<n + 1, (42) 



and, by (|4T 



|K-K + i||< Qn Qn+1 ||K||< a " ^ llyllfi + TT^r)- v»< »„ + i. (i3) 

a„+i a n +i \ u — 1 



Inequalities (J33J) and ([4311 imply 

, c 2 a n -a n+1 M 2 , ,. / 2 \ 

Sn+i < — 5n H c i> c o = c i = IMI 1 + y-, — 7 , (44) 

a n a n+ i z \ u — I J 

for all n < no + 1. 

By Lemma [6] and Remark [71 the sequence (a n )^ =1 , satisfies conditions fI31) - (fT8]) . pro- 
vided that do is sufficiently large and A > is chosen so that ([20]) holds. Let us show by 
induction that 

9n < y , < n < n + 1. (45) 
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Inequality ([15]) holds for n = by Remark Suppose (j4"5j) holds for some n > 0. From 
15J) and CEFJ), one gets 

, co ( a n \ 2 a n — a n+ \ 

9n+i < — I -r- H Ci 

a n \ a J a n+ i 

coa n i a n — a n+ i (4g) 



\2 + Cl 

A z a n+ i 



A 

Thus, by induction, inequality (|45l) holds for all n in the region < n < no + 1. 

From Remark [3] one has ||Vn|| < ||y|| + This and the triangle inequality imply 

8 

IN - Un\\ < \\uo\\ + \\Zn\\ + \\V n \\ < \\uq\\ + \\z n \\ + \\y\\ H . (47) 

Inequalities (|42p. (|45p . and (|47p guarantee that the sequence u n , generated by the iterative 
process ([25]) . remains in the ball B{uq, R) for all n < uq+1, where R < s ^ + \\uo\\ + \\y\\ + -£-. 
This inequality and the estimate (J36]) imply that the sequence u n , n < uq + 1, stays in the 
ball B(uo,R), where 

R < -j + \\uq\\ + \\y\\ + \\y\\ _ - ■ 

By Remark [HI one can choose ao and A so that ^ is uniformly bounded as 5 — > even if 
Mi(R) — > oo as R —* oo at an arbitrary fast rate. Thus, the sequence u n stays in the ball 
B(uo, R) for n < no + 1 when 5^0. An upper bound on R is given above. It does not 
depend on 5 as 5 — > 0. 
One has: 

\\F(u n ) - M| <\\F(u n ) - F(V n )\\ + ||F(vy - mi 

<M l9n +\\F(V n )-f s \\ (48) 

<^ + \\F(y n )-f s \\, Vn<n + 1, 

where (}4"5|) was used and Mi is the constant from ([3]). Since ||.F(V^) — Ml is nonincr easing, 
by Lemma [U and m < no, one gets 

||F(K 0+1 ) - M| < ||F(K 1+1 ) - M| < CS. (49) 

From (TTSD, (HSJ), (0SD, the relation ([MD, and the definition C x = 2C - 1 (see (|5D|I). one 
concludes that 

l|FK„ +1 ) -All <^±l + cs 

< w(g-D +CT 2C _ < 50 > 

A||y|| 

Thus, if 

\\F(u ) - Ml > CxP, 0< 7 <1, 
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then one concludes from (foDj) that there exists rig, < rig < uq + 1, swc/i f/iai 

II^KJ - <Ci<T< 0<n<n,5, (51) 

/or any given 7 6 (0, 1], and any /ixed Ci > 1. 

Let us prove (f27l) . If n > is fixed, then u$^ n is a continuous function of f§. Denote 

um = lim us at, (52) 

where Af < 00 is a cluster point of ns m , so that there exists a subsequence of ns m , which 
we denote by n m , such that 

lim n m = N. 

m— >oo 

From (|52p and the continuity of F, one obtains: 

ll-F(fiiv) " Ml = lim \\F(u ns J- f s \\ < lim CW = 0. 

Thus, u n is a solution to the equation -F(n) = /, and (|27l) is proved. 

Let us prove ()29p assuming that (j28|) holds. From ()26[) and (|48p with n = ns — 1, and 
from ([5Tj) . one gets 

< Mx^-i + on^ill^-ill < Afx^-i + HyK,-! + 0. 

If < 5 < 1 and 5 is sufficiently small, then 

'Mi 



C<F<a„ 5 -il + ], C>0, 

where C is a constant. Therefore, by (|14p . 

£ <5 1-7 /Mi , ,, . 

lim < lim < lim — ^- — - + y =0, < 7 < 1. (53) 

5^0 2a n , <5^o a n ,_i «5^o C \ A ' ! 



□ 



From (I28p and (|53p . by Theorem 6.3.1 in [5], one gets (|29p . Theorem 1101 is proved. 
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